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An Adaptive Video Image Information Processing System 

This is a divisional application of United States Patent Application 
Serial No. 09/712,539 by K. F. Horlander, filed November 14, 2000 which is a 
5 divisional application of issued United States Patent 6,437,830 by K. F. Horlander, 
filed December 3, 1999. 

Field of the Invention: 

10 The present invention relates to selecting a format for recording, 

reproducing and display of video image information received with a signal including 
conditional access information, the conditional access information determining the 
format for recording, reproduction and display of the video image information. 

15 Background of the Invention 

Conditional access systems for subscriber units such as cable 
subscriber set-top box decoders are well-known in the art. Conditional access is 
conventionally achieved by downloading one or more authorization levels for storage 

20 in the decoder. The stored authorization levels may be represented by a bit map or a 
list of individual multi-bit codes, or a combination of both. Each received 
subscription program, which is normally scrambled to prevent access thereto by an 
unauthorized subscriber, includes an authorization code or conditional access 
information identifying the associated program. If the conditional access information 

25 corresponds to an authorized level in the stored bit map or a stored listed 
authorization level of the subscriber, a descrambling circuit within the subscriber's 
decoder is enabled to descramble the signal for viewing by the subscriber. If the 
received conditional access information does not match any stored authorization level 
descrambling of the accompanying program is inhibited or prevented. 

30 Such conditional access systems lack the operational flexibility that is 

desirable for taking advantage of the features and capabilities that are supported by 
the new generation of digital decoder set top boxes. It is desirable for set top boxes 
and other decoder systems to be able to provide a user with additional pricing and 
subscription choices for recording, reproduction and/or display of a video image 

35 based upon personal taste and the capabilities of the subscriber's video equipment. 
The system described herein addresses these needs 
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SUMMARY OF THE INVENTION 



5 Video image information is received in a signal including conditional 

access information. The conditional access information is associated with one of a 
plurality of picture resolution formats for recording, reproducing and displaying the 
video image information. The conditional access information in the received signal is 
decoded. A format for at least one of recording, reproducing and displaying the video 
10 image information is adaptively selected in response to the decoded conditional 

access information. The video image information is then processed using the selected 
format. The conditional access information may further include information 
indicating a predetermined time period during which reproduction of recorded video 
image information is permitted. 

15 

BRIEF DESCRIPTION OF THE DRAWING 



Figure 1 shows a Vertical Blanking Interval (VBI) data format 
facilitating adaptive data recovery and decoder operation, according to invention 
20 principles. 



Figure 2 shows the Vertical Blanking Interval (VBI) data format of 
Figure 1 incorporating a particular configuration of header and payload data, 
according to invention principles. 

25 

Figure 3 shows a video system including a High Definition (HD) video 
decoder, a video monitor and a VCR employing the VBI ancillary data format of 
Figure 1 for selecting decoder processing functions based on copy protection 
information, according to invention principles, 

30 

Figure 4 shows a video system similar to the system of Figure 3 
employing the VBI ancillary data format of Figure 1 for selecting further decoder 
configurations, according to invention principles. 



35 



Figure 5 shows a video system similar to the system of Figure 3 
employing the VBI ancillary data format of Figure 1 used in another decoder 
configuration, according to invention principles. 
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DETAILED DESCRIPTION OF THE DRAWING 

Figure 1 shows a Vertical Blanking Interval (VBI) data format 
5 facilitating adaptive data recovery and decoder operation. The data format 
advantageously facilitates adaptive decoder multiple mode operation in different data 
detection and recovery modes. The data format also advantageously employs a data 
bit period that accommodates data encoded using clock rates associated with different 
standards. Specifically, the data format of Figure 1 employs a quadrature (i.e. a 

10 "1010" bit pattern) reference symbol start pulse (item 10 of Figure 1) of half a byte 
duration that substantially starts at the start of active video of a horizontal video line 
(item 29 of Figure 1). The use of such a quadrature reference symbol, defined to start 
at the beginning of active video, enables a decoder to detect and recover data by either 
of two different recovery methods. Such a data format enables a decoder to recover 

15 data either by, (a) pulse detection following synchronization to the quadrature 
reference symbol using a phase locked loop, for example, or (b) line-locked pulse 
detection, without prior phase locked loop synchronization, based on the known 
(active video) start time of the reference symbol following the horizontal sync pulse 
of the analog video signal. Further, the double pulse (i.e. 1010) bit pattern of 

20 reference symbol 10 offers improved phase lock loop synchronizing capability over a 
single pulse (i.e. 10) bit pattern as exemplified by the VBI data signal reference pulse 
sequence of the EIAJ CPR- 1204-1 standard. This is because the reference symbol 
provides a detector circuit with a larger number of pulse edges for use in detection 
and synchronization in comparison to the single pulse reference symbol pattern. 

25 The data format of Figure 1 also employs a data bit period that 

accommodates data encoded using clock rates associated with different standards. 
Specifically, the bit period of the Figure 1 data format is advantageously selected to 
comprise a first integral multiple of a first clock period associated with a first data 
format, and a different second integral multiple of a second clock period associated 

30 with a second data format. In the data format of Figure 1 the ancillary data bit period 
is selected to be a multiple of, (a) 20 times the 27 MHz clock period associated with 
EIA 770. land EIA 770.2 video standards (and also associated with the MPEG system 
standard ISO 13818-1 section 2.5.2.1), and also a multiple of, (b) 55 times the 74.25 
MHz clock period associated with the EIA 770.3 video standard (item 31 of Figure 1). 

35 The resultant selected bit period of the Figure 1 data format is approximately 741 
nano-seconds in duration. In Figure 1, the ancillary data bit period of item 33 
comprises a multiple of 60 times an 8 1 MHz clock period which is used as a video 



clock in a number of digital video systems. Also, since the 81 MHz clock period is an 
integral multiple (i.e. a 3 times multiple) of a 27 MHz clock period the bit period of 
the Figure 1 data format accommodates data encoded using 81 MHz, 27 MHz, and 
74.25 MHz (and other integral multiple) clock rates associated with different 
5 standards. 

The multi-standard compatible bit period of the data format of Figure 1 
enables ancillary data to be encoded by devices operating with clock frequencies 
associated with any one of a number of different standards e.g. with the 27 MHz clock 
frequency of the EIA 770.1, EIA 770.2 or MPEG standards or with the 74.25 MHz 

10 frequency of the EIA 770.3 standard. The resultant ancillary data, incorporated within 
an analog video signal VBI (and compatible with the format of Figure 1), is 
recoverable and decodable by a decoder without the need to know the standard 
employed by the originating device. 

The features of the Figure 1 data format facilitate adaptive data 

15 recovery by either, (a) phase locked loop synchronized pulse detection and (b) line- 
locked pulse detection independent of phase locked loop synchronization. These 
features also facilitate the adaptive decoding of ancillary data provided by devices 
operating using different video coding standards (e.g. EIA 770.1, EIA 770.2, EIA 
770.3 or MPEG standards). Further, the combination of quadrature reference symbol 

20 and multi-standard compatible bit period provides significant flexibility, adaptability 
and simplicity advantages for inter-device communication between cost sensitive 
consumer devices such as televisions (including analog, digital and high definition 
TV (HDTV)), VCRs, digital video disk (DVD) players and set top boxes etc. 

The Figure 1 data format supports communication of multiple data 

25 types and services including, captions, conditional access information, copy 
protection data, configuration information, display format/standard identification data, 
descriptive data and control information. This information is conveyed in the ancillary 
data format of Figure 1 on a horizontal line in the VBI e.g. on line 42 of a 2H display 
system (a display system using substantially twice the NTSC horizontal line rate). 

30 Alternatively, it may be incorporated on this line or another line in a IH or 2.14H or 
other line rate system. The ancillary data format includes a header byte (item 15 of 
Figure 1) that identifies a destination service for a payload of the ancillary data or an 
address identifying a destination of the payload. The address comprises 7 bits (item 
25) and a single parity bit (item 27). The parity bit in the address header enables error 

35 detection to be performed on individual header bytes. The address bits (item 25) may 
comprise a service identifier e.g. identifying payload data as being caption, 
configuration, display format, video standard, conditional access, copy protection. 



description or other control information. Alternatively, the address bits may comprise 
another identifier associated with the payload data and the parity bit may be omitted. 

The ancillary data format also includes two payload bytes (item 20 of 
Figure 1) as may be used for EIA770.3 standard communication, for example. In 

5 other embodiments, the data format structure may include different numbers of header 
and payload bytes. The header address or service identifier (item 15) is associated 
with the two byte payload (item 20). One or more of the payload data bits may also be 
allocated as a parity bit for use in detecting payload errors in individual payload data 
segments (e.g. for individual bytes or for both bytes together). The payload data may 

10 also be used to transport larger messages in multiple video frames conveyed in 
multiples of two byte segments. For this purpose, the header (or payload in another 
embodiment) includes information that indicates a message is being sent in multiple 
horizontal line ancillary data segments and that may also enable the segments to be 
assembled into a single message. Further, an error detection and/or correction code 

15 may be conveyed with the payload data to validate and correct messages. 

Figure 2 shows the Vertical Blanking Interval (VBI) data format of 
Figure 1 incorporating a particular configuration of header and payload data. Figure 2 
shows a single byte payload as may be used for EIA770.3 standard communication, 
for example. In Figure 2, the first payload byte is allocated to be a service identifier 

20 (item 40). Consequently, both an address (item 15) and a service identifier (item 40) 
are associated with a single byte payload (the remaining byte of item 20). As a result, 
the payload data may be flexibly processed by different devices for different 
functions. Alternatively, both the header byte (item 15) and one byte of the payload 
(item 20) may be used to provide a single 16 bit address or service identifier. Thereby 

25 extending the range of identifiers and addresses that may be used. 

The ancillary data is encoded on luminance information (Y) in a Y Pr 
Pb luminance-chrominance format video signal. The ancillary data may also be 
identically encoded on each of the color signals in an RGB format video signal or may 
be conveyed on only or two of the color signals. Alternatively, each individual 

30 component signal of an RGB or Y Pr Pb format video signal may be used to convey 
different ancillary data. The ancillary data may be similarly conveyed in the 
component video signals of other format video signals. 

Figure 3 shows a video system including a High Definition (HD) video 
decoder 110, a video monitor (e.g. TV) 100 and a VCR 105 employing the VBI 

35 ancillary data format of Figure 1 for selecting decoder processing functions based on 
copy protection information. In other embodiments, decoder 110 and monitor 100 
may be combined in a single unit. The copy protection information is compatible with 



a Copy Generation Management System (CGMS) document (including CGMSA - 
analog and CGMSD - digital versions) referenced in a proposed Video Home 
Recording Act of March 14, 1996 intended for submission to the 104*** Congress (as 
yet not submitted), but may alternatively conform to other formats. In the system of 

5 Figure 3, the ancillary data format of Figure 1 is used to adaptively convey and update 
copy protection configuration information for different video display formats and 
modes. Specifically, the ancillary data is used to provide different display and record 
privileges for different display formats or record modes. Such different display 
formats may include, for example, high definition TV (HDTV) or standard definition 

10 TV (SDTV) formats. The different recording modes may include, for example, modes 
involving recording text, captions, web pages, or Picture-in Picture (PIP) images 
associated with individual programs. The ancillary data format of Figure 1 may also 
be used to communicate other control information between a decoder and a display or 
record device or between other devices for optimizing video and audio reproduction. 

15 Such additional control information may include audio control and program 
description data, parental ratings information and also date and time information. 
Thus, a simple monitor could look at this data and automatically optimize and 
configure its display and audio reproduction functions. 

In the system of Figure 3, video decoder 110 adaptively decodes and 

20 converts received broadcast high definition video data to provide either high 
definition (HD) digital MPEG compatible video data, standard definition (SD) digital 
MPEG compatible video data or an analog composite video signal for storage on 
VCR 105. Decoder 110 configures VCR 105 for both recording mode and copy 
protection processing modes using control and configuration information conveyed in 

25 the ancillary data (per the Figure 1 format) in the VBI of the NTSC compatible 
composite video output by decoder 110. Note, the ancillary data in the composite 
video signal is advantageously used to configure VCR 105 in all recording modes e.g. 
in modes comprising recording a program in digital MPEG compatible HD signal 
format or digital MPEG compatible SD signal format or as an analog composite video 

30 signal. 

In an exemplary recording mode, decoder 110 provides high definition 
MPEG compatible digital video data representing a program to VCR 105 for 
recording. Decoder 110 configures VCR 105 to record the high definition MPEG data 
it receives in high definition format using configuration data conveyed in ancillary 
35 data in the VBI of the NTSC compatible composite video output by decoder 1 10 to 
VCR 105. VCR 105 is a multi-function unit capable of converting between different 
video formats both for recording and upon playback. For this purpose, VCR 105 



contains an upsampling interpolator for converting SD video data to HD video data 
and a downsampling interpolator for converting HD video data to SD video data, 
VCR 105 also contains MPEG decoding/encoding and analog to digital and digital to 
analog conversion and sampling functions to convert between digital HD and SD data 

5 and analog composite video data. VCR 105 selects a signal recording format and 
converts the input signal data (HD, SD or composite analog) to the desired format for 
recording, in response to configuration and copy protection information received from 
decoder 1 10. VCR 105 also blocks recording or playback of prohibited material in 
response to the copy protection information. 

10 The signal format conversion capability of VCR 105 enables VCR 105 

to adaptively select a signal format for recording or playback, in response to copy 
protection information received from decoder 1 10. Thereby, VCR 105 advantageously 
selects play back or recording modes (and associated display formats) as well as 
subsequent copying limitations (e.g. prohibiting subsequent copying, allowing one 

15 subsequent copy, or unlimited subsequent program copying) based on copy protection 
data reflecting User designated billing and conditional access options. As a result, a 
User may only be allowed to record a program in a particular format and to view a 
program on playback in a particular format based on the User's pre-selected billing 
options. Such a particular format may comprise, for example, one of the HD, SD or 

20 analog signal formats. Similarly, the copy protection data may allow time based 
limitations based on a User's pre-selected billing options. Such limitations may permit 
a User to view a program upon playback for a limited period e.g. 3 months only. In 
addition, the copy protection data may allow a combination of time based and signal 
format limitation allowing playback and display of a program for a specific period 

25 (e.g. 3 months) in one format (e.g. HD format) and another period (e.g. a subsequent 
year) in a different format (e.g. SD format), for example. 

It is to be noted that in other embodiments VCR 105 may receive and 
process MPEG SD video data or an analog composite video signal for recording. 
Also, VCR 105 may include the capability of converting between different display 

30 formats including, a IH line rate format, a 2H line rate format and a 2.14H line rate 
format and other formats either for recording or upon playback. VCR 105 may also 
include the capability of providing a desired interlaced format (e.g. 1920 x 720 pixel 
resolution) or progressive format (e.g. 1920 x 720 pixel resolution) for recording 
operation or upon playback, by the use of additional sample rate converter 

35 interpolation functions. Further, the adaptive conversion and copy protection 
functions of VCR 105 may alternatively be located in a separate unit e.g. decoder 1 10 
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or in a single combined unit that includes the functions of both decoder 1 10 and VCR 
105. 

Figure 4 shows a video system similar to the system of Figure 3 
employing the VBI ancillary data format of Figure 1 for selecting further decoder 
5 configurations. The Figure 4 system includes High Definition (HD) video decoder 
130, a video monitor (e.g. TV) 100 and a VCR 129 employing the VBI ancillary data 
format of Figure 1 for selecting decoder processing functions based on copy 
protection information. Decoder 130 advantageously provides both IH and 2H line 
rate format signals to VCR 129 and video monitor 100. This enables decoder 130 to 

10 configure VCR 129 using the ancillary data format of Figure 1 (conveyed in the IH 
or 2H composite signal VBI) to process either IH (e.g. NTSC format) or 2H (e.g. 
1920 X 1080 pixel resolution) video and audio formats. Further, VCR 129 includes 
the capability of converting between IH line rate format, a 2H line rate format (or 
2.14H line rate format) either for recording or upon playback. Alternatively, this 

15 conversion may be performed within decoder 130. 

Figure 5 shows a video system similar to the system of Figure 3 
employing the VBI ancillary data format of Figure 1 used in another decoder 
configuration. The Figure 5 system includes High Definition (HD) video decoder 130, 
a IH line rate display format video monitor (e.g. TV) 100 and a 2H line rate format 

20 VCR 125 employing the VBI ancillary data format of Figure 1. In the Figure 5 
system, decoder 130 both communicates with and configures monitor 100, using 
ancillary data conveyed in the VBI of a IH line rate (e.g. NTSC compatible) analog 
composite video signal. Further, decoder 130 communicates with, and configures, 
VCR 125 using ancillary data conveyed in the VBI of a 2H line rate (e.g. EIA 770.1 

25 compatible) analog composite video signal. In an exemplary recording mode, decoder 
130 provides 2H line rate compatible analog composite video representing a high 
definition program to VCR 125 for recording. Decoder 1 10 also configures VCR 125 
to record this program in 2H line rate format. In playback mode, VCR 125 converts 
the recorded 2H line rate format video to IH line rate format video for output to 

30 monitor 100 for display. This is performed in response to User initiation of a playback 
command and configuration information conveyed from decoder 130, identifying the 
display monitor as a IH format monitor. Alternatively, VCR 125 may convey the 2H 
line rate video to decoder 130 for conversion by decoder 130 to IH line rate format 
and display on monitor 100. In another embodiment, VCR 125 converts the 2H line 

35 rate format video, from decoder 130, to IH line rate format for recording in IH format 
in response to configuration information conveyed from decoder 130 in the VBI of 
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the IH line rate signal. The recorded IH line rate video is output to monitor 100 for 
display in response to User initiation of a playback command. 

The ancillary data structure of Figures 1 and 2 is not constrained to be 
conveyed in analog composite video of IH, 2H or 2.14H line rates but may be 
5 conveyed in an analog or digital video signal using any line rate. Further, the ancillary 
data may be used for control purposes in other system configurations not just those 
described in connection with Figures 3-5. In addition, other ancillary data structures 
may be derived in accordance with the principles embodied in the adaptive data 
recovery and multi-standard compatibility characteristics of the format of Figures 1 
10 and 2. 



